Skip to content

DO NOT MERGE — CI check for the v1.0.0 release tree - #92

Closed
Xof wants to merge 1 commit into
mainfrom
ci-check/v1.0.0-squash
Closed

DO NOT MERGE — CI check for the v1.0.0 release tree#92
Xof wants to merge 1 commit into
mainfrom
ci-check/v1.0.0-squash

Conversation

@Xof

@Xof Xof commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Do not merge

This PR exists only to get a real CI run against the exact tree that's sitting on `release/v1.0.0` (an orphan commit with no shared history with `main`, which GitHub won't open a PR against directly). The diff below is the real content delta — just the version bump, 7 files.

Once CI is green here, this PR should be closed without merging. The actual history swap happens separately via `release/v1.0.0` (see the other open PR/instructions), not through this one.

@Xof
ci: validate the v1.0.0 release tree
a025218 
Temporary — same-history carrier for the exact file content on
release/v1.0.0 (an orphan branch GitHub won't open a PR against),
so CI can run against it before that branch replaces main's history.
Not meant to be merged normally.
@github-actions

github-actions Bot commented Jul 9, 2026

Copy link
Copy Markdown

🚦 Bench results: PR vs main

⚠️ 21 regression(s) detected across 10 scenario/mode pair(s)

Scenario Mode Δ throughput Worst Δ
document-store chisel-mem -29.8% p95 +54.8% ⚠️
mutation-log chisel-mem -30.0% p50 +43.3% ⚠️
ycsb-a chisel-mem -19.6% p50 +27.8% ⚠️
ycsb-a redb-strict +0.1% p99 +25.8% ⚠️
ycsb-b chisel-mem -12.7% p99 +22.6% ⚠️
ycsb-b chisel-strict +4.2% p50 +19.2% ⚠️
ycsb-b redb-strict +0.4% p50 +18.2% ⚠️
document-store chisel-strict +8.6% p50 +11.0% ⚠️
document-store sqlite-strict +0.0% p50 +6.4% ⚠️
document-store redb-strict +3.3% p50 +5.7% ⚠️
mutation-log chisel-strict +1.4% —
mutation-log redb-strict +0.1% —
mutation-log sqlite-strict +1.0% —
ycsb-a chisel-strict -0.7% —
ycsb-a sqlite-strict -1.3% —
ycsb-b sqlite-strict -1.6% —
Per-scenario detail (4 metrics × cells)

document-store

Mode Throughput p50 p95 p99
chisel-mem 32649 ops/s → 22924 ops/s (-29.8%) ⚠️ 5.2 µs → 5.5 µs (+6.7%) ⚠️ 69.7 µs → 107.9 µs (+54.8%) ⚠️ 299.5 µs → 447.3 µs (+49.3%) ⚠️
chisel-strict 2780 ops/s → 3018 ops/s (+8.6%) 13.4 µs → 14.9 µs (+11.0%) ⚠️ 1.12 ms → 1.05 ms (-6.7%) 2.71 ms → 2.66 ms (-1.9%)
redb-strict 4009 ops/s → 4139 ops/s (+3.3%) 18.6 µs → 19.7 µs (+5.7%) ⚠️ 631.5 µs → 585.6 µs (-7.3%) 1.63 ms → 1.72 ms (+5.7%)
sqlite-strict 5103 ops/s → 5104 ops/s (+0.0%) 21.3 µs → 22.6 µs (+6.4%) ⚠️ 449.4 µs → 491.1 µs (+9.3%) 1.49 ms → 1.56 ms (+4.3%)

mutation-log

Mode Throughput p50 p95 p99
chisel-mem 46597 ops/s → 32625 ops/s (-30.0%) ⚠️ 26.6 µs → 38.1 µs (+43.3%) ⚠️ 35.3 µs → 45.3 µs (+28.0%) ⚠️ 41.2 µs → 55.0 µs (+33.3%) ⚠️
chisel-strict 1665 ops/s → 1688 ops/s (+1.4%) 498.4 µs → 517.1 µs (+3.8%) 955.4 µs → 901.6 µs (-5.6%) 7.87 ms → 7.34 ms (-6.8%)
redb-strict 1806 ops/s → 1808 ops/s (+0.1%) 198.0 µs → 194.6 µs (-1.7%) 348.1 µs → 314.7 µs (-9.6%) 27.82 ms → 29.16 ms (+4.8%)
sqlite-strict 4528 ops/s → 4572 ops/s (+1.0%) 132.2 µs → 134.2 µs (+1.5%) 362.1 µs → 363.1 µs (+0.3%) 557.9 µs → 611.8 µs (+9.7%)

ycsb-a

Mode Throughput p50 p95 p99
chisel-mem 34874 ops/s → 28032 ops/s (-19.6%) ⚠️ 48.6 µs → 62.1 µs (+27.8%) ⚠️ 64.6 µs → 82.1 µs (+27.1%) ⚠️ 89.7 µs → 103.1 µs (+14.9%) ⚠️
chisel-strict 2105 ops/s → 2091 ops/s (-0.7%) 340.5 µs → 356.6 µs (+4.7%) 1.03 ms → 1.07 ms (+4.7%) 3.01 ms → 2.97 ms (-1.3%)
redb-strict 2679 ops/s → 2682 ops/s (+0.1%) 150.8 µs → 153.2 µs (+1.6%) 257.1 µs → 275.7 µs (+7.2%) 645.3 µs → 811.6 µs (+25.8%) ⚠️
sqlite-strict 148214 ops/s → 146310 ops/s (-1.3%) 6.9 µs → 6.9 µs (-0.7%) 8.7 µs → 8.9 µs (+2.2%) 10.9 µs → 11.5 µs (+5.7%)

ycsb-b

Mode Throughput p50 p95 p99
chisel-mem 245098 ops/s → 214028 ops/s (-12.7%) ⚠️ 1.4 µs → 1.5 µs (+10.1%) ⚠️ 49.2 µs → 53.6 µs (+9.1%) 54.5 µs → 66.8 µs (+22.6%) ⚠️
chisel-strict 19676 ops/s → 20495 ops/s (+4.2%) 2.8 µs → 3.3 µs (+19.2%) ⚠️ 359.1 µs → 375.7 µs (+4.6%) 951.7 µs → 894.3 µs (-6.0%)
redb-strict 27019 ops/s → 27128 ops/s (+0.4%) 2.7 µs → 3.2 µs (+18.2%) ⚠️ 154.2 µs → 154.6 µs (+0.3%) 243.8 µs → 241.5 µs (-0.9%)
sqlite-strict 181102 ops/s → 178155 ops/s (-1.6%) 5.6 µs → 5.6 µs (+0.5%) 7.8 µs → 7.5 µs (-3.9%) 10.3 µs → 9.8 µs (-4.4%)
Generated by chisel-bench-diff at 2026-07-09T21:58:35Z. Compares PR HEAD against main. Never blocks merge — signal, not gate. Thresholds: throughput 5%, p50 5%, p95 10%, p99 10%.

@Xof

Xof commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator Author

Superseded — the release tree changed (crates.io/PyPI package rename to chisel-storage, dependency security fix, publish workflows added). New CI-check PR incoming for the updated tree.

@Xof Xof closed this Jul 9, 2026
@Xof Xof mentioned this pull request Jul 9, 2026
Closed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

No reviews

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

1 participant

@Xof